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ABSTRACT 

The use of a schema analysis, or hierarchical 
classification system, to identify problem-solving approaches among 
principals with different levels of experience is examined in this 
paper. Forty-one students in Ontario— 10 undergraduate teacher 
preparation students, 8 teachers with principal qualifications, and 
23 principals grouped according to 3 levels of job 
experience — participated in a fact-finding exercise, thinking-aloud 
session, and discussion of a case study. Findings demonstrate the 
existence of interpretable differences between inexperienced and 
experienced principals. Higher scorers recognized the link between 
the case study and school climate issues. Both high and low scorers 
shared several features: a reflection of experience; reliance on 
outside resource people; search for further data; and awareness of 
the importance of promoting staff self-ei>teem„ Conclusions are that 
the schema analysis is useful for the systematic dissection of 
complex cases and is applicable to broader problem-solving areas and 
studies with larger sample sizes. Appendices contain the case study, 
analytic schema, and four tables. (6 references) (LMI) 
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Introduction an- Data Collection 
This paper, part of a symposium "Perspectives on Principals' Problem 
Solving", presents an analysis of the responses of 41 subjects to a case study, 
■Miss McDonald". The subjects Include ten student, In undergraduate teacher 
preparation, eight practising teachers who hsve achieved the qualifications to 
become a principal (by Ontario law), eight principals In their first or second 
year of the prlnclpalshlp, seven with 10 to 15 years, and ,lght with more than 
20 years. These groups are known as Entrants, Aspirants, Rookies. Seasoned, and 
Veterans respectively. (Avoidance of the terms expert and novice Is deliberate.) 
The nature and origins of the sample studied are detailed In the Introductory 

paper bearing the symposium title. 

The case study Itself Is Included as Appendix A to this report. Briefly. 

It describes a situation Involving conflict between a school staff and the school 

librarian. The situation Involves elements of supervision, curriculum, policy. 

ln t«rp«r*onal relations, physical plant, budget and supply, and staff attitudes. 

The central character Is the librarian, Miss McDonald, and there Is one other 

named protagonist, Miss Green. The situation was presented to each subject for 

solution In the role of a principal new to the school. 

Most of the subjects (the exception, were the Entrants) were brought 
together in sets of four for a day, and asked to produce data In various forms 
as described In the rest of the symposium. Each day began with a warm-up and 
discussion, and then each research team member took one subject for Individual 
data collection. These Individual sessions began with a fact-finding exercise In 
which subjects were told they would be presented shortly with a case study, and 
were Invited to ask questions concerning the school environment in which the case 
would be set. This exercise was followed with training In the think aloud 
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process using suggestions fro- Ericsson and Si-on (1984), and finally subjects 
went on to the case study. Here, subjects were first asked to read the case 
aloud, interjecting their thoughts as they read. Then, they were asked to think 
aloud about how they would solve the problem. Finally, they were asked to recall 
their thought processes. The degree of separation between reading and solving 
varied across subjects, as did the degree of thoroughness with which the final 
recall was treated. The case analysis took between 45 and 100 minutes for each 
subject. Procedures for the Entrants differed in that they were dealt with 
individually rather than in groups of four, and they did only the fact finding 
and case study aspects of the data collection. 

Data were actually collected from eight subjects in each of the four more 
experienced groups. However, three transcripts were lost, but in two cases, this 
was discovered in time for the subject and interviewer to attempt a joint 
reconstruction of the case solution. Thus, we report data from 41 subjects, 10, 
8l 8, 7, and 8 respectively, from the five experience levels. 

Analysis 

The essence of the procedure used to analyze the data is to build a 
collective storyline, across subjects, capturing the variety of responses to the 
problem, including values exhibited, perspectives taken, and actions planned. 
Within this collective framework, then, individual responses to the problem can 
be highlighted and compared. An earlier version of this collective story-line 
or schema was initially reported in Nagy (1990). That analysis showed that 
organization of the category system can facilitate its use. Many decisions on 
categorizing statements into the seven major content areas were difficult, but 
problems were minimized by organizing the categories from more global (the 



problem solving process) to .ore specific srea. (the librarian). It «as a .ore 
..reels* and less taxing task to postpone categorisation only when a statement 
clearly fit a narrower category than to postpone when the statement only fit a 
broader category. 

k limitation to the analysis was found, however. Segmentation of the 
prot ocol into units for analysis, determination of when one thought unit ends and 
another begins, depends on striking a balance between capturing detail and 
producing a manageable category system. It turned out that the category system 
became unwieldy before all data elements In a single category were sufficiently 
homogeneous to distinguish levels of experience and expertise In the data set. 
Because of this difficulty, an additional analysis was developed. This system, 
modelled on Biggs and ColUs (1982) , uses a 4-polnt scale to rate the amount of 

^formation dealt with by each subject within the statements assigned to each 

schema category: 

1: makes one or two points without supporting argument or elaboration 

2: makes one or two points with supporting argument or elaboration 

3: makes two points and relates the. to each other with supporting 

argument or elaboration 
U: makes more than two points and relates them to each other with 

supporting argument or elaboration. 
The interpretation of these definitions evolved during analysis. It was 
„ot always clear whether the rating scale addre,sed quality or quantity. There 
were times when the quality of what was said was not captured by the system, and 
other times when unadorned quantity (I.e., number of ideas) was misleading, 
particularly If the subject simply listed several unrelated points. In practice 
the counting of -points- from the above definitions sometimes took second place 
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.£ experts In the field. These analyses at. not entirely straightforward for two 
reasons. First, on average slightly fewer than one-half of the 41 subjects said 
anything In and received a rating for each category. Thus, more than one-half 
the data In a subjects-by-categorles matrix are "0". To Justify the analysis of 
variance, these -0" ratings must be considered as missing data rather "fall- re 
to score". Otherwise, the data are badly skewed and the ANOVA Is not 
appropriate. Second, controlling the Type I error rate when performing pair-wise 
comparisons involving five experience groups and .11 categories of the detailed 
schema requires some discussion. A 10% Type I error probability was achieved 
using the Dunn multiple comparison method (Marascullo and Serlln, 1988). 
Categories with too few non-zero entries and degrees of freedom to yield a viable 
test, about one-third of the categories, were eliminated. Then a tvo-talled alpha 
for each separate comparison of 0.0000793 gave the required overall 0.10 level. 
Degrees of freedom varied, of course, with the number of subjects who had non- 
zero ratings for each category. 



Results 



Tbf Cn11ecT|v« Schema 

The detailed schem. contains 92 categories grouped under seven major 
topics. It is included In this report as Appendix 8. The following narrative 
has been produced fro. the detailed classification of statements made by all 
subjects. It is of necessity limited In detail compared to the original 
transcripts of all subjects. As well, the order In which different Individuals 
dealt wit!. Issues Is lost. However, the narrative line conveys better than the 
tabular results an overall flavour of the collective approach of the respondents. 
It is best thought of as a companion description to set the more detailed r ? «ults 
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in context. It serves further to avoid tedious repetition In the sections 
following, repetition which would otherwise be needed to continually set context 
for the reader. The bracketed numbers come fro. the detailed category system 

reported In Appendix B. 

Most subjects spent some time talking about the problem at the most global 
level (1). They chose to speak about the -true nature- of the problem (1.1), and 
often about their own problem solving processes and preferences (1.2). Some felt 
that It was a symptom of underlying Issues such as morale (1.1.1), others that 
It was several problems (1.1.4), and still others that It was a straightforward 
and localized Issue (1.1.5). Some felt that more data were needed to determine 
If there really was a question to be addressed (1.1.2), while others felt either 
that something needed to be done, or that the wrong action could make things 
worse (1.1.3). Those who spoke of the problem solving process talked generally 
of how they planned for action (1.2.1), of the role past experiences play in 
their problem solving (1.2.2), of the Importance of information and how to get 
it (1.2.3), or of the development of action plans and/or subproblem 
Identification (1.2.4). Some spoke of developing staff ownership of problems as 

a basic strategy (1.2.5). 

A few respondents related the problem to the wider community (2) and school 
system (3). Some expressed a lack of Information about the community (2.3), 
while others thought that community or student input to the library operation 
would be desirable (2.1). Some traced the library problems to a deterioration In 
community morale (2.2). In the context of the school district, a couple of 
subjects asked about board policy (3.1), and a similar number talked of 
consulting with their colleagues (3.2). Most of the references to the school 
system, however, were calls for support staff assistance (3.3). 



Q 



About hall the respondents made some reference to the wider school context 
of the problem (4). These responses were of four kinds, concerning school goals 
(4.1), school atmosphere (4.2), the timetable (4.3), and the role of the vice- 
principal (4.4). 

All of the subjects dealt with the remaining three categories of the 
schema, the library (5). personnel (6). and the librarian herself , Miss McDonald 
(7). The statements concerning the library fell Into three categories, defining 
the role of the library (5.1), discussing present practice (5.2), and improving 
the library operation (5.3). Those dealing with the role of the library talked 
about how they felt about letting the librarian run her -own show- (5.1.1), 
provincial policy (5.1.2), finding out what the staff expected of a library 
(5.1.3), and of their own expectations (5.1.4). Those who discussed present 
practice either diagnosed on the basis of Information given (5.2.1) or outlined 
further Information they might need and how they would get It (5.2.2). The 
discussions of librae Improvement focused on policy Implementation (5.3.1. the 
largest category), the library collection (5.3.2), organization and procedures 
(5.3.3), the location and appearance (5.3.4). or the image of the library 
(5.3.5). 

Statements concerning the staff were categorized Into four larger areas: 
gaining entry as a new principal (6.1), building trust and avoiding conflict 
(6.2), running a successful staff meeting (6.3), and, the largest, staff 
development (6.4). The entry Issues were either diagnosing the difficulties the 
principal In the case caused hi. or herself (6.1.1) or outlining how to get to 
K „ow people better (6.1.2) , both personally and professionally. The discussions 
of trust and conflict were either comments on the Importance of the issue (6.2.1) 
or specific strategies for practice (6.2.2). Discussion of meeting strategies 
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were either explanations of what went wrong in the case (6.3.1) or strategies for 
doing a better job (6.3.2). The largest personnel cate S ory, staff development, 
fell into five sub -categories : tea. building (6.4.1), leadership development 
(6.4.2), causing change (6.4.3), dealing with Miss Green, the case study 
character who had the blow-up with the librarian (6.4.4), and the problem of 
older, entrenched teachers (6.4.5). 

The last section of the schema dealt with the librarian herself, Miss 
McDonald (7), and was divided into four major sections, diagnosis of the problem 
(7.1), further data collection (7.2), dealing with her request for a transfer 
(7.3), and supporting her towards improvement (7.4). The diagnoses were positive 
or neutral (7.1.1), negative (7.1.2), or concerned with the possible causes of 
her request for a transfer (7.1.3). Further data collection involved asking her 
about her personal feelings (7.2.1) or her plans for the library (7.2.2). Some 
decided they would ask others about her (7.2.3), and others felt th,»y wanred to 
observe her in action or examine her files (7.2.4). The responses to her request 
to transfer were to get her out for her own good (7.3.1), to remove her for the 
good of the school (7.3.2), *r to remove her only after possible remediation .iad 
failed (7.3.3). The discussion of support fell into four categories: personal 
support and confidence building (7.4.1), help with interpersonal skills (7.4.2), 
improvement of library skills (7.4.3), and development of her leadership 
potential (7.4.4) . 

The schema, as developed, has five levels of substructure. This seems 
close to the workable maximum, but yet, in examining specifics, the need for 
further detail continually arises. This difficulty led to the use of rating 
scales within the categories, reported next. 
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■p,. p„1« of r.«i.erlence 

Three kinds of Information ere presented In Table 1. First, Table 1 
includes a breakdown of the number, of statements mad. and their rating. In the 
seven global areas. Each block of the table contains the numbers of statements 
g lven each rating within each experience group. Second, across the bottom of 
each of these blocks appear, In brackets for visual clarity, the percentages of 
Che total discussion that focused on each of these topics. TMrd, below the table 
ere summarized the results of analyses of variance done within each schema 
cetegory across experience levels, using alpha - 0.01 for each ANOVA to produce 
.„ experlment-wlse risk of Type I error of 0.08. Hote that the percentages are 
derived from totals across rating levels, and thus Ignore the ratings themselves. 
!„ contrast, the analyses of variance treated the ratings as the dependent 
variable, and the total number of rating, a, the *H* for each test. Thus, the 
percentages reflect quantity, and the ANOVA quality of statements made. 

************************* 

Insert Table 1 about here 
************************* 
A, can be seen, more than 90% of the discussion either deal: with the 
process of handling problems, or took place wlthl , the specific, of the staff. 

tw* was very little mention of the role of the 
library, and librarian. There was very 

u i ^c^Hct o~ even of the broauer school context. The focus 
community or school district, o* even 

, n th(t case W as very specific. The category on the 
of much of the responses to the case was veiy v 

problem solving process Itself (#1) 1. as popular as it is probably because, as 
one subject put it, he knew that was why he had been invited. In addition, we 
al s. probed specifically for recall, and -any of the statements made about 
problem solving were in this context. In the absence of our probing, most of the 

u 
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subjects would have dealt, we suspect, with only the narrow context Immediately 
surrounding the specific Issues raised by the case. 

Looking at the percentages across the experience levels, what is most 
remarkable is the absence of really substantial trends related to experience. The 
clearest trends are for the more experienced respondents to spend a bit lass time 
talking about the library and the librarian, and a bit more time on the staff and 
on the process of problem solving. In some contrast, the analysis of variance 
reveals that the quality of response from the Entrants Is generally poorer than 
from those with classroom and administrative experience. 

As can be seen from, for example, the four entries In the bottom right hand 
corner of Table 1, typical responses are categorized roughly as 20%. 50%, 25%. 
and 5% at each of the four rating levels. In four of the eight section of the 
table, the seven large topics plus the total, there are significant differences 
in overall quality of response. In each of these four sections, the Entrants 
exhibit lower quality responses than some of the groups with administrative 
experience, but do not differ significantly from the Aspirants, who have 

classroom experience only. 

Detailed analysis across experience groups for individual schema categories 
was carried out by first eliminating from consideration the 19 categories with 
fewer than six responses and insufficient degrees of freedom for any test 
statistic. Second, another ten categories with six or seven responses (one or 
two degrees of freed**) were also eliminated, as these tests cannot produce 
statistically significant differences no matter how bunched these responses might 
be. For example, fo'. df - 2. a difference of about 45 in group totals is required 
for a significant difference between groups, but even if all seven responses were 
coded "4" and were by individuals in the same experience group, the largest 
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possible group total difference would be 28. Elimination of these categories 
leaves only 63, and the Individual comparison alpha required for a two- tailed 
test with 5» in each tall Is 1.00 - .05/630 - .999*207. 

Table 2 contains the results of Dunn multiple comparisons within these 63 
categories. Categories showing no significant differences have been removed, 
revealing significant differences between experience groups in 22 of the 
categories. The cutoff scores vary with degrees of freedom, or the number of non- 

zero ratings within each category. 

************************* 
Insert Table 2 about here 
************************* 
Hardly any of the differences between groups In Table 2 have a simple 
.onotonlc relationship with experience, although If we adopt a flexible stance 
«s to what constitutes a trend (by declaring one of the groups as an outlier), 
some generalizations are possible. 

Within the Problem Solving categories of the schema, there Is a tendency 
for those with more experience to recognize the complexity of the problem, to 
delegate to their staff more and, naturally enough, to reflect upon and relate 
their experience. The trend under #3, The System, can be traced directly to the 
difference between having a classroom teacher perspective and devel,plng a more 
global view. Within the Library categories, there Is a trend for those with less 
experience to be more accusatory toward Kiss McDonald, which Is somewhat 
contradictory to the tendency for less experienced people to recognize the need 
for further Information on her performance. Two very clear trends, however, are 
for .those with more experience to be unwilling to Impose a solution on the staff, 
and to recognize that Miss McDonald will be more forthcoming In a -e-on-one 
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situation than at a staff meeting. 

A clear trend with experience, noticeable In the first three categories 
listed under #6, Personnel, Is the development of strategies with experience. 
Although groups did not differ significantly In their ability to recognize staff 
problems, they differed quite systematically In their knowledge of what might be 
done about these problems. Within this s/jm section, we can see the failure of 
Inexperienced people to recognize how disastrous the staff meeting In the case 
was. We also see little concept of team building and staff development from those 
with little experience. As an aside, although we did not explore It 
systematically, It Is worth hypothesizing a difference In training between those 
who qualified for the prlnclpalshlp ten or more years ago, and those who have 
been trained quite recently. The trends In the last section of Table 2, on Miss 
McDonald herself, seem the most variable with experience However, It Is clear 
that those with experience recognize the need to boost her self-esteem. 

The literature Is clear that there Is no simple relationship between 
experience and expertise, so the equivocal nature of some of the results in Table 
2 Is not surprising. With this context, we turn to the examination of expertise. 

The Role »f Expertise 

As part of the project, three professors of educational administration were 
given summaries of the transcripts of all but the Entrants and asked to rate each 
performance on a 10-polnt scale. The summaries were In the respondents' own 
words, but gave only the actions taken and Immediately surrounding text. Only 
summaries were provided due to the length of the transcripts; even with the 
actual reading of the case study text removed, the 31 responses run to some 200 
single-spaced pages. Based on these mean ratings, the five lowest scoring and 
five highest scoring subjects were selected. The lowest scoring were three 
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Rookies and two Veteran., while the highest scoring were two Rookies and three 

Seasoned principals. 

Tsble 3 contains a summary of the result, comparing these two groups of 
five subjects Judged to have responded at high and low levels of expertise. 
First, as can be seen by the raw totals In the bottom section of the table, the 
high group had about 501 more statement, than the low (Ignoring statement 
ratings). However, as Judged by the percentages assigned to each of the main 
sections of the schema, the relative emphasis of the - groups was largely 
comparable. The largest difference In emphasis was In section .6, Personnel. 
When the ratings are taken Into account and analysis of variance performed, the 
two groups differed significantly In the quality of what was said for the Library 
section. »5. and for the overall total. One Interesting anomaly In the data 
occurs in the Personnel section: although the difference was not statistically 
significant, the low-rated group actually provided more higher quality 
statements, rated 3 and 4. than the hlgh-rated group. This suggests that 
attention, even quality attention, to general personnel Issues of entry, rapport, 
conflict resolution, and staff development and super-lslon were not highly 

regarded by the panel of experts. 

************************* 

Insert Table 3 about here 

************************* 
Table 4 shows the differences between the high-rated and low-rated groups 
1„ the detailed categories of the schema. Unfortunately . due to the small group 
sues, the Dunn multiple comparison technique (Marascullo and Serlln. 1988) used 
to produce the results of Table 2 will produce only one or two significant 
differences, even If the probability of Type 1 error Is allowed to rise to 20%. 

15 
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To get around this problem, and with the goal of being able to compare 
differences related to expertise with those related to experience, we increased 
the value of the difference required between the two group totals before judging 
that difference -reportable" until we had achieved a number of differences across 
expertise comparable to that across experience (19 In Table 4 compared ro 22 In 
Table 2). As It happened, this ad hoc cutoff score for Table 4 is 6, which Is 
quite commensurate with those found in Table 2, considering the differences In 

group size between the two tables. 

************************* 

Insert Table 4 about here 
************************* 
With only two groups to compare, all the differences in Table 4, unlike 
Table 2, give the (possibly dangerous) appearance of being clearly Interpretable. 
Some interesting differences appear in section 1 of the schema. Those rated 
highly tenced to engage In group planning, as opposed to the counterpart 
category, 1.2.1.1, which dealt with needing time to reflect In private. While 
those scoring well talked about the role of experience in their deliberations, 
those scoring poorly tended to dwell on specific -war stories" from their past. 
Other characteristics of quality problem solving Include recognizing the need for 
more data, and attacking major Issues in bits and pieces. 

In the broader context, high scorers were attuned to the usefulness of 
district level assistance, and recognized the link between the case study problem 
and issues of the general atmosphere in the school. With respect to the library, 
they clearly announced to staff their own expectations for its operation, they 
recognized that Miss McDonald's Input was important, and that she ought to be 
aske<! her views In private. They also recognized that Improvement of the library 
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collection was required, end that they again required further Information on the 
present situation. 

Interestingly, within the Personnel section are two categories on which the 
low scoring group put -ore emphasis: discussing strategies for conflict 
resolution, and encouraging staff change. It may be that. In the view of the 
panel of judges, these topics were considered digressions fro. the central Issue. 
Topics which show trends In the expected direction Include running an effective 
meeting, collecting more data (again), and having patience with the rate of 
change. Within the last section, the Librarian, three strong trends appear, all 
related to giving the problem back to Miss McDonald, and Increasing her self- 
confidence and responsibility for herself. 
fvpgTtj'e «nd E vnerlence 

Finally, we can compare the differences between inexperienced and 
experienced principals with the differences between high rated and low rated 
responses. Remembering that three of the five highly rated responses came from 
the more experienced (Seasoned) principals, both these groups shared several 
features: they tended to reflect on experience, rely on outside resource people, 
recognize the need to get further data. Increase library holdings, work with Miss 
McDonald privately, and attempt to Increase her self-confidence and ownership of 
the problem. 

Discussion 

This report has examined the potential of schema analysis for 
distinguishing between responses to a case study presenting an Ill-structured 
problem. Earlier work (Nagy. 1990) had uncovered limits to the ability of an 
hierarchical category system alone to capture the detail of response In such 
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complex situations. Because of this, the analysis reported here Incorporated a 
rating scale, used within the schema system, and based on the quality of the 
analysis offered rather than the topics touched upon. It Is significant that, 
with the addition of these ratings, the conclusions drawn In terms of the 
commonalities across Tables 2 and 4 are quite different from the analysis In Nagy 
(1990). 

This present analysis appears clearly successful. The collective schema 
approach to protocol analysis Is manageable, even with very large data sets and 
very complex problems. The results show Interpretable differences between 
Inexperienced and experienced principals. As well, they can be related iv a 
sensible manner to independent judgments of response quality. Further, it has 
been possible to Identify elements of expertise which are related to experience 
as well as others which are not. 

Several issues arise from this analysis. First, It Is necessary to ask what 
such a detailed and complex analysis provides with respect to understanding of 
the prlnclpalshlp that a less detailed and non-hlerarchlcal classification system 
might not. At the least, the analysis has proven useful In dissecting the 
complexity of the case study In a systematic manner. Beyond that, however, It 
has provided a type of -territorial map- of Issues facing the principal, a map 
which might be expanded relatively easily by examination of similar data obtained 
from responses to other carefully constructed case studies. The advantage of 
this is not only that results might be compared, but also that such work Is made 
vastly easier and less expensive through the use of such a tool. Certainly the 
degree of agreement between the data coders Is as high as this type of analysis 
in such a complex area Is likely to achieve. 

Second, we need to consider the implications of such analysis beyond school 
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administration, examining the broader issue of lll-structured problem solving. 
Thl. approach has potential for student assessment In subject areas where ill- 
structured problem are encountered, such ». any of the social sciences. 
Systematic research on how teachers grade Is thin, but there is see evidence 
(for example. Nagy. Evans and Robinson, 1988) that quality of argumentation takes 
second place to recall of facts and to writing style and skill. 

Third, this research needs to be placed In the context of other approaches 
Co Ul-structured problem analysis. Lawrence (1988) examined magistrates' 
thought processes In sentencing, using as her data base three magistrates dealing 
with three cases. Voss. Greene. Post «. Penn.r (1983). investigated how subjects 
would deal with the lack of productivity of the Soviet agricultural system, 
categorizing statements as pertaining to goal, or reasoning, using fewer than 20 
subjects. Relying heavily on this earlior work, the present study has moved to 
considerably larger sample sizes and some hint of ouantlflcatlon while 
n aintalnlng what appear to be roughly comparable levels of detail and research 
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Appendix A 
Miss McDonald A Case Study 



i. i-> p^ inn« in the following case. Please read out 

<, . u.-i- r <s is an eighteen r»o« elementary school (grades JK - 8) 
Sugar Maple P.S. . is an eignieeu building Is rather 

located in a lower -nlddle class are. of * *™",' l ' y - ™ e lv ° ely to , CCOB1 ,odate 
old; It -as built as a high school ^^^^^^^ and du rlng 
£ SrST-St - -MS ^Wjn Septe-ber , g***?* 
library which £ ^J^£ r s",ui e'sSaU tt'tt" appeared to be few 
not only were *e the Interests of the older students. During 

S27lr7t w«k of .choo e i y p.t suggested to Mis, MacDonald, the school te.cher- 
Ubrarlan. t"at she drop Into the office to talk about the library. 

► i - p.t- Tnnp« had time to check Into some of Miss 
HacDonatoTba^rounu'.nd ^nf t at "she ^^^^^ 

sch ool "^^Lf/eacheTsa W h. her° tuTn""'-^: use the library as 
teachers; the grade ' "* ch « s "° ™" 1 secretary assigned to the library 

there -ere few lo^uV' o"u"^ over Whether or not she 

no l~.ger worked there since a blow ^ up ^ o£ ^ lous 

^^r^* ^ revested b to 0k b; transferred fro. the library to a 
classroom in another school. 

uh.n Miss MacDonald came in for their meeting, Pat Jones told her that she 
bad not^r °£n.f.r b.c.us. sh. ^lance^t 
that If she aade her request ..rll.r_ *ls year * e « ^gh ^ free 

LThetr^r., S J«=Ha5f^^ oPerrf^e 

Krco^nTwt^r r M S^f r ^srs 1- sis 

each year. Pat Jones ^^i*"**; In which the library could be 

next staff aeetlng to discuss j with the staff « .ys In y 

used. Miss MacDonald re.arked that sh . « " ««Uto »* ouU send out S a 

Sr. 'on th\r tfac^s^co^ tVl"^^ ^ftrence for their scheduled 
library periods. 

l, i.t-*r Miss Green a first year teacher with a grade seven class, 
Two weeks later, M * ss Green ' * E MacDonald had told her not to leave her 
complained to Pat Jones that «U. thftt thls was unfalr beC ause 

children unattended In the Ub«*y. they caBe to library period, -to 

Miss MacDonald was ""^^ extra preparation time 

take a prep ^i^S/rJones told Miss Green that library periods wew not 
te"ttr prVparTtion periods; the school had a Partners in Action 
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program In place, and classroom teachers vera supposed to be working together 
with the librarian to plan the use of the library resources as part of the total 
program Miss Green looked a little sheepish, but left the office obviously 
dissatisfied. Pat Jones was concerned that the library problem was bigger .nan 
It originally looked, and determined to do something about it Immediately. 

At the next staff meeting, Pat Jones Introduced the topic of the library. 
Several teachers, apparently representing the majority, declared that thare was 
nothing wrong with the library or the way It had always ope rated ^ few felt 
that although they valued the scheduled library periods, they would appreciate 
Tvl'treeLto se nd individuals and small groups to the library for special 
Elects and assignments. Miss MacDonald expressed concern about who would 
supervise these students and went on, In an obviously emotional state, to express 
he? belief that there should be more co-operative projects between teachers and 
librarian- she felt that staff members were not making use of her services; 
sometimes* she felt she was not earning her salary. Someone a.ked her what she 
meant by co-operative projects; someone else asked for examples of services she 
could offer to staff .Miss MacDonald, who was extremely nervous by now, was 
unaoL to answer. One of the older staff members suggested In a friendly way, 
that Miss MacDonald should consider taking a leadership training course. 

The meeting ended very soon thereafter, with no agreements or decisions 

made. 

vou are Pat Jones. How will you handle the situation? Please think out 
loud as you consider this situation and your reactions to It. 
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Appendix B 
The Schema 

1 PROBLEM SOLVING 

1.1 Definition of the problem 

1.1.1 Problem has underlying issues 

1.1.1.1 Fault of past administration 

111 2 Symptom of communication or morale 
1 1 2 There may not be a problem. Is this better left alone? 
1.1.3 No or poor actions may have consequences 

114 There are several related problems 

115 Problem confined to library or personnel -within- library 

1.2 Problem solving process 

1,2 i l 2 P lTietl for perspective, time, visualization (alone) 
1*2 1 2 Brainstorming, evolution of plans (group) 

RenecclonTon role of experience (not specific Incidents 
1.2.2.2 Specific incident frca past 

1.2.3 Role of Data 

1 2.3.1 Specific data collection strategies 
1.2.3.2 Recognition ttut data is required 

1.2.4 Problem Elements 

1.2.4.1 Set some priorities, action plan 

1.2.4.2 Identify subproblems or tackle bits 

1.2.5 Staff involvement 

1.2.5.1 Develop ownership among staff 

1.2.5.2 Delegate, share with staff 

2. COMMUNITY , ^ _ rv 

2.1 Seek community and student input to library 

2.2 Build community morale 

2.3 Investigate nature of community 

3. SYSTEM . 

3.1 Ask about board policy or procedure 

3.2 Consult with colleague 

3.3 Bring in resource 

4. SCHOOL 

4.1. School goals 

4.1.1 Jointly establish school goals 

4.1.2 Set expectations for school 
4 2 Atmosphere of school 

4.2.1 Methods to improve 

4.2.2 Recognize need to examine 
4.3 Timetabling 

4.3.1 Methods to improve 

4.3.2 Recognize need to examine 

."3 



4.4 Vice-Principal 

4.4.1 Set expectations with/for 

4.4.2 Get Info from or use 



THE LIBRARY 



5.1 Role of the library 

5.1.1 Comments on "own show" 

5.1.1.1 State disagreement with "own show" 

5.1.1.2 State agreement with "own show" 

5.1.2 State Partners In Action policy (without personal endorsement) 
5 13 Seek Input of staff expectations 

5.1 A State personal expectations re library (may Include reference 
PIA) 

5.2 Present practice 

5.2.1 Diagnosis of present practice 

5.2.1.1 Problem with Miss M 

5.2.1.2 Problem with older staff, excluding Miss M 
5 2 13 Problem with school or administration 

5.2.2 Recognize that data gathering on present practice Is required 

5 . 3 Improvement 

5.3.1 Library policy lmolementatlon 

5. 'J. 1.1 Initiate demonstrations and provide examples 

5.3.1.2 Scheduling and compromise on use 

5.3.1.2.1 Imposed on staff 

5.3.1.2.2 Negotiated with staff 

5.3.1.3 Staff professional development 

5.3.1.3.1 Principal owned and directed 

5.3.1.3.2 Staff owned 

5.3.1.4 Miss M's plans and Ideas for library 
5.3.1.4.1 Required her to present to staff 

5 3 1.4.2 Request that she present to principal 

5.3.1.5 Active principal leadership In library improvement 

5.3.2 Holdings 

5.3.2.1 Discuss Inventory, culling, budget history 

5.3.2.2 Increase holdings 

5.3.2.3 Tie Increase to needs of program or interests of students 

5.3.3 Organization 

5.3.3.1 Theft 

5.3.3.1.1 Discuss only 

5.3.3.1.2 Improve procedures 

5.3.3.2 Get secretarial/volunteer assistance 

5.3.4 Location and appearance, school plant 

5.3.4.1 Noting and discussing 

5.3.4.2 Changing 

5.3.5 Image Improvement by various means 



PERSONNEL 



6.1 Entry, data gathering and rapport 

61 6 1 l D i a i n proble» with lateness of own appointment to job 
6.l'.l'.2 unfamiliarity with staff will be an issue 

6 " 1 6 2 l S 2 r i t For e fa a iliari Z ing self with staff at a personal level 
6.1.2.2 For interviewing staff at a professional level 

6.2 Resolution of conflict, building of trust 

6.2.1 Recognizing importance 

6.2.2 Outlining strategies for improvement 

6.3 Staff meetings 
6 3.1 Diagnosis 

6.3.1.1 Poor move to put Miss M on the spot 

6. 3. 1.2 Bad meeting in general 

6.3.2 Strategies for an effective meeting 

6.3.2.1 Plan, have data 

6.3.2.2 Other 

6.4 Staff development and supervision 

6 4.1 Team building , M1 u 

6.4.2 Leadership development within staff, excluding Miss M 

6.4.3 Change 

6.4.3.1 Comments that it takes time 

6.4.3.2 Encourage 

6.4.3.3 Build from key staff 

6.4.4 Miss G 

6.4.4.1 Neutral and positive diagnoses 

6.4.4.2 Negative diagnoses 

6 4 4 3 Recognition that further data is required 

6.4.5 Entrenched teachers (incl. Miss M when appropriate) 

6.4.5.1 Diagnoses 

6.4.5.2 Strategies 

6.4.5.2.1 Develop 

6.4.5.2.2 Move 



7 MISS MCDONALD 



7.1 Diagnosis 

7.1.1 Neutral or positive 

7.1.2 Negative 

7.1.3 Transfer request 



7.2 Data collection 

7.2.1 Feelings & perceptions from Miss M (on problem, not 1 brary) 

7.2.2 Data collection on Miss M from others 

7 ' 2 ] 3 Data collection on Miss M from own observations and files 

7.3 Transfer resolution 

7.3.1 Transfer soon for supportive reasons 

7.3.2 Transfer soon for program reasons 

7.3.3 Transfer only after attempts at remediation 



7.4 Support 

7.4.1 Increase her happiness and confidence 

7.4.1.1 From self 

7.4.1.2 From others 

7.4.2 Group and Interpersonal skills 

7.4.2.1 Diagnosis of group and interpersonal skills 

7. 4. 2. 2 Strategies for increasing group and interpersonal skills 

7.4.3 Increase her library skills 

7.4.4 Leadership development, ownership 
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Experience Level 



Schema 
Category 



Entrants 



Aspirants Rookies Seasoned Veterans Total 



1, Problem 
Solving 



Rating 



2. Community 



3. System 



4. School 



5. Library 



1 
2 
3 
4 

(%) 

1 
2 
3 
4 

(%) 

1 
2 
3 
4 

(%) 

1 
2 
3 
4 

(%) 

1 

2 
3 
4 

(%) 



6. Personnel 



7. Librarian 



All 



18 
33 

4 

1 

(21) 

0 
4 
0 
0 

(1) 

1 
3 
1 
0 

(2) 

2 
2 
0 
0 

(1) 

21 
47 
17 
1 

(32) 



1 


16 


2 


29 


3 


7 


4 


0 


(%) 


(19) 


1 


14 


2 


38 


3 


10 


4 




(%) 


(23) 


1 


72 


2 


156 


3 


39 


4 


3 



8 

25 
10 
4 

(21) 



15 

25 
9 
4 

(23) 



*♦ 

25 
11 
6 

(22) 



o 


0 


0 


3 


2 


1 


2 


0 


1 


1 


0 


0 


(3) 


(1) 


\ L ) 


1 


1 


1 


2 


4 


4 


0 


2 


2 


0 


0 


0 


(1) 


(3) 




4 


1 


0 


4 


9 


6 


2 


0 


4 


0 


0 


1 


(4) 




\j) 


10 


10 


5 


33 


23 


25 


16 


21 


19 


J 


6 


6 


(29) 


(26) 


(26) 


10 


12 


6 


25 


21 


29 


11 


14 


12 


5 


5 


2 


(22) 


(23) 


(25) 


7 


10 


7 


20 


20 


22 


15 


12 


11 


2 


5 


2 


(19) 


(20) 


(20) 


40 


49 


23 


112 


104 


112 


56 


58 


60 


19 


20 


17 



12 


57 


16 


124 


12 


46 


9 


24 


,25) 




1 


1 


3 


13 


1 


4 


0 


1 


(3) 





3 
1 
0 
0 

(2) 

1 
5 
0 
1 

(4) 

10 
19 
17 
4 

(26) 

11 
14 
18 

5 

(22) 

6 
16 
8 
1 

(16) 

44 
73 
57 

2,0 



7 
14 
5 

0 



8 

26 
6 
2 



56 
147 
90 
24 



55 
118 
62 
17 



44 
116 
56 
11 



228 
557 
270 
79 



ERIC 



i , 3 , 7 nsd between Groups; Category 1, #1< #4 & #5; Category 5, 
Categories 2, 3, 4, 7, nsa wwwn Totals Group 1 < all others. 
#1 < #3 & #4; Category 6, #1 < #5, Totals, *tuu P 



Table 2 

S s teBfl Categor y, mth glmlffmnr Mffrrrnm BeJa2££B Experience Croups 



Category 



1. Problem Solving 

1.1.4 Several related problems 

1.2.2.1 Reflections on experience 

1.2.2.2 Specific past incident 
1.2.5.2 Delegate, share with staff 

3. System 

3.3 Bring in resource person 

5. Library 

5.2.1.1 Problem is with Miss M 
5.2.2 Need data on present practice 

5.3.1.2.1 Impose compromise 

5.3.1.4.2 Miss M's ideas in private 

5.3.2.2 Increase library holdings 

6. Personnel 

6.1.2.1 Strategy for befriending 

6.1.2.2 Strategy for interviewing 

6.2.2 Strategy for conflict resol. 

6.3.1.2 Diagnose poor meeting 
6.4.1 Team building 

6.4.3.3 Build on key staff 
6.4.4.3 Require more data on Miss G 

7. Librarian 

7.2.3 Observe & get file data 
7.3.1 Transfer soon for own good 
7.4.1.1 Boost confidence personally 

7.4.3 Increase M's library skill 

7.4.4 Develop, give ownership 



Experience Group Rounded Totals 1 Rounded 

Cutoff 2 



Ent 


Asp 


Rook 


Seas 


Vet 




2- 


3 


7 


9+ 


1- 


7 


3- 


4- 


4- 


19+ 


12+ 


8 


0- 


4 


3- 


11+ 


11+ 


7 


6 


7 


2- 


7 


11+ 


8 


0- 


2 


8+ 


8+ 


4 


8 


9 


9+ 


5 


4 


2- 


7 


11 


14+ 


8 


13+ 


3 


9 


14+ 


3- 


8 


4- 


4- 


7 


7. 

# 


7- 


7- 


16+ 


12 


9 


6 


6 


2- 


/ 12+ 


5 


7 


2- 


4- 


2- 


12+ 


7 


7 


11 


15 


8- 


7- 


18+ 


10 


7 


4- 


4- 


12+ 


5 


7 


2- 


5 


11+ 


8 


5 


7 


2- 


3- 


11+ 


6 


5 


7 


0- 


12+ 


2- 


9f 


15+ 


7 


2 


8+ 


3 


9+ 


0- 


7 


11 


8 


5- 


13+ 


3- 


8 


8+ 


1- 


7 


7 


7 


7 


2- 


12+ 


"11+ 


12+ 


9 


8 


3- 


11+ 


6 


5 


3- 


7 


2- 


5 


5 


9+ 


0- 


7 



'Plus and minus signs indicate significant differences using a Dunn multiple 
comparison procedure with experiment-wise alpha - 0.10 Group totals have 
been adjusted to equal group size for ease of calculation, and rounded for 

visual clarity. , ... - „ 

2Cutoff score is the minimum value by which group totals must difer for 
significance using the Dunn test. It reflects alpha, t^, the number of 
subjects with statements in each category, and the standard error of the 
difference between totals. 
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Schema Category 



1. Problem Solving 



2. Community 



3. System 



4. School 



5. Library 



6. Personnel 



7. Librarian 2 



Total 1 



Rating 
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Significantly different, p < .005 
Significantly different, p < .05 



Low 



2 a 



High 



1 
1 


6 


3 


2 


8 


17 


3 


5 


9 


4 


4 


5 


(%) 


(21) 


/AAV 

(22) 


1 


0 


0 


o 
I 


1 


1 


3 


o 


1 


4 


0 


0 


(%) 


(1) 


(1) 


1 


9 


0 


2 


o 


4 


3 


o 


1 


4 


0 


0 


(%) 


(2) 


(■*) 


i 


1 


0 




1 


5 


3 


o 


1 


4 


0 


1 


(%) 


(2) 


(4) 


1 


8 


5 


2 


12 


14 


3 


6 


16 


4 


1 


8 


(%) 


(25) 


(27) 


1 


9 


2 


2 




21 


■j 


9 


9 


4 


6 


2 


(%) 


(27) 


(21) 


1 


7 


4 


2 


12 


16 


3 


3 


8 


4 


1 


4 


(%) 


(21) 


(20) 


1 


33 


14 


2 


39 


78 


3 


23 


45 


4 


12 


20 



Table 4 

Schema Categories with Substantial Differences between Expertise Group? 



Category 

Low-Rated Group High-Rated Group Difference 



1. Problem Solving 

1.2.1.2 Brainstorming, group planning 0 6 6 

1.2.2.1 Reflections on experience 5 11 6 

1.2.2.2 Specific past incident 



6 0-6 



1.2.3.2 Recognize that data Is required 5 13 8 

1.2.4.2 Attack subproblems 7 IS 8 



3. System 

3.3 Bring In resource person 

4. School 

4.2.1 methods to improve atmosphere 

5. Library 

5.1.4 State personal expectations 

5.2.2 Need data on present practice 
5,3.1.4.2 Miss M's Ideas in private 
5.3.2.2 Increase library holdings 

6. Personnel 

6.2.2 Strategy for conflict resol. 
6.3.2.2 Strategy for running meeting 

6.4.3.1 Note that change takes time 

6.4.3.2 Encourage change 

6.4.4.3 Require more data on Miss G 



1 7 6 

0 7 7 

4 12 8 

0 8 8 

2 12 10 

1 9 8 

8 2-6 

0 6 6 

1 9 8 

9 0-9 
0 6 6 



7. Librarian 

7.3.3 Transfer only after trying to help 0 
7.4.1.1 Boost confidence personally 2 

7.4.4 Develop, give ownership 1 
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